System and method for document processing

ABSTRACT

Embodiments of the present invention are directed to document processing, and more particularly to systems and methods that can utilize relative positions between the content of the document and a decodable indicia affixed to the document. In one embodiment, indicia reading terminals are provided that include an imaging module for capturing a frame of image data of a document. The document can include one or more decodable indicia such as a form barcode and various content fields, which delineate particular content of the document. The form barcode can include information respecting the form design and form design data. This information can be used to process the content of the document such as by providing coordinates or similar location and positioning metrics for use in processing the content of the document. In one example, the frame of image data is analyzed to identify the form barcode, from which the relative location of the content fields can be discerned without extensive processing of the frame of image data.

FIELD OF THE INVENTION

The present invention relates to systems and method for processingdocuments, and more particularly to an embodiment of a system, andmethod implementing the same, in which content of the document isidentified relative to a reference associated with a decodable indiciaaffixed to the document.

BACKGROUND OF THE INVENTION

Indicia reading terminals are available in multiple varieties.Well-known among the varieties is the gun style terminal as commonlyseen at retail store checkout counters. Other terminals are alsoavailable that provide enhanced functions, have keyboards, and displays,and include advanced networking communication capabilities.

These terminals are useful to read and decode the information encoded indecodable indicia. Such decodable indicia are utilized generously, fromencoding shipping and tracking information for packages to any number offorms and documents including, but not limited to, tax forms, orderforms, transaction forms, survey forms, delivery forms, prescriptions,receipts, newspapers, product documents, reports, and the like.Moreover, while terminals and scanners are commonly used to decode thedecodable indicia on these forms and documents, other devices may beused such as devices that can produce a digital version of the formand/or the document.

These devices typically utilize image sensors to decode informationencoded in bar code symbols, and more particularly to process with barcode decoding algorithms captured images of the forms and documents. Theavailability of higher density image sensor arrays such as arrays thathave ever increasing numbers of pixels, however, has increased thenumbers of pixel values that must be processed to obtain the informationcoded in, e.g., the bar code symbology. Although the greater number ofpixel values generally provides image representations of higherresolution, such resolution comes at the cost of processing speed.

There is a need for systems that include these terminals for processingdocuments that are operatively configured to identify content of thedocument in a highly reliable and accurate fashion without substantiallysacrificing processing time.

SUMMARY OF THE INVENTION

As discussed in more detail below, there is provided systems and methodsfor processing documents that have improved processing characteristics.Embodiments of these systems can include indicia reading terminalsoperatively configured to decode decodable indicia affixed to thedocument to locate content relative to a reference associated with thedecodable indicia.

In one embodiment, a system for processing a document. The systemcomprises an indicia reading terminal comprising a two dimensional imagesensor array comprising a plurality of pixels extending along an imageplane, an optical assembly for use in focusing imaging light rays ontothe plurality of pixels of said two dimensional image sensor array, anda housing encapsulating the two dimensional image sensor array and theoptical assembly. In one example, the system is operative in a mode inwhich the system, in response to an operator initiated command, capturesa frame of image data and processes the frame of image data forattempting to decode a form barcode on the document. In another example,the system is operative to identify a coordinate system on an imageplane from information stored in the form barcode. In yet anotherexample, the system is yet further operative to identify relative to theform barcode and in the coordinate system the position of a contentfield located on the document. In still yet another example of thesystem, processing of the frame of image data on a first document havingthe form barcode disposed thereon is faster than processing of the frameof image data on a second document without the form barcode.

In another embodiment, a system for automatedly handling documents. Thesystem comprises an indicia reading terminal comprising a twodimensional image sensor array comprising a plurality of pixelsextending along an image plane, an optical assembly for use in focusingimaging light rays onto the plurality of pixels of said two dimensionalimage sensor array, and a housing encapsulating the two dimensionalimage sensor array and the optical assembly. The system also comprisesan external server in communication with the indicia reading terminal,the external server external to the indicia reading terminal. In oneexample, the system is operative in a mode in which the system, inresponse to an operator initiated command, captures a frame of imagedata and processes the frame of image data for attempting to decode aform barcode on the document. In another example, the system isoperative to form an image plan on which is located a grid respecting acoordinate system. In yet another example of the system, the grid hasgrid points established from at least one corner of the form barcode. Instill another example, the system is operative to identify on the grid acontent field with coordinates in the coordinate system that correspondto information encoded in the form barcode. In still yet another exampleof the system, processing of the frame of image data on a first documenthaving the form barcode disposed thereon is faster than processing ofthe frame of image data on a second document without the form barcode.

In yet another embodiment, a method of processing a document comprises astep for capturing a frame of image data corresponding to the documentand a step for processing the frame of image data to locate a formbarcode affixed to the document. The method also comprises a step forestablishing a coordinate system on an image plane respecting thecaptured image data. The method further comprises a step for locatingrelative to the form barcode and on the coordinate system a contentfield on the document. In one example of the method, processing of theframe of image data on a first document having the form barcode disposedthereon is faster than processing of the frame of image data on a seconddocument without the form barcode.

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited features of the presentinvention can be understood in detail, a more particular description ofthe invention briefly summarized above, may be had by reference to theembodiments, some of which are illustrated in the accompanying drawings.It is to be noted, however, that the appended drawings illustrate onlytypical embodiments of this invention and are therefore not to beconsidered limiting of its scope, for the invention may admit to otherequally effective embodiments. Moreover, the drawings are notnecessarily to scale, emphasis generally being placed upon illustratingthe principles of certain embodiments of invention.

Thus, for further understanding of the concepts of the invention,reference can be made to the following detailed description, read inconnection with the drawings in which:

FIG. 1 is a schematic diagram of a document with features consistentwith concepts of the present disclosure;

FIG. 2 is a schematic diagram of an image plane of the document of FIG.1;

FIG. 3 is a schematic diagram of an exemplary indicia reading terminal;

FIG. 4 is a flow diagram of one example of a method for processing adocument, such as the document of FIG. 1, utilizing a decodable indiciaaffixed to the document;

FIG. 5 is a flow diagram of another example of a method for processing adocument, such as the document of FIG. 1, utilizing a decodable indiciaaffixed to the document;

FIG. 6 is a flow diagram of yet another example of a method forprocessing a document, such as the document of FIG. 1, utilizing adecodable indicia affixed to the document;

FIG. 7 is a flow diagram of still yet another example of a method forprocessing a document, such as the document of FIG. 1, utilizing adecodable indicia affixed to the document;

FIG. 8 is a is a perspective, exploded, assembly view of an example ofan imaging module for use in the indicia reading terminal of FIG. 3;

FIG. 9 is a perspective, assembled view of another example of an imagingmodule such as the imaging module of FIG. 5, for use in the indiciareading terminal of FIG. 3;

FIG. 10 is a perspective view of an indicia reading terminalincorporating an imaging module such as the imaging module of FIGS. 6and 7; and

FIG. 11 is a block diagram of an exemplary hardware platform forimplementation in an indicia reading terminal such as the indiciareading terminal of FIGS. 3 and 10.

DETAILED DESCRIPTION OF THE INVENTION

Concepts of the present invention that are presented below can beimplemented as part of document management and/or document processingsystems that are configured to capture image data of a document, toprocess the captured document image data, and to identify aspects (orareas or fields) of the document by way of processing the captureddocument image data. To reduce processing time, and thus improvethroughput, accuracy, and reliability of such systems, embodiments ofthe present disclosure can utilize decodable indicia such as bar codesto identify the aspects of the document upon which the decodable indiciais affixed. One embodiment, for example, can implement decodable indiciaor a form barcode with information decoded therein respecting thelocation, position, and other characteristics that correlate thelocality of fields within the document relative to the form barcode.This correlation is beneficial because it can reduce processing time andthe possibility of error by bringing forward during processinginformation about the document which would normally require extensiveprocessing of the captured document image data.

To further understand these concepts, and referring now to FIG. 1, thereis provided an example of a document 100 with features that are made inaccordance with concepts of the present invention. As depicted in FIG.1, the document 100 can have a structure 102 with boundary features 104and a content area 106 defined at least to some extent by the boundaryfeatures 104. Inside of the content area 106 there is document content108 such as text associated with the subject matter of a form (e.g., anIRS form). The document content 108 can be configured into one or morecontent fields 110 such as a text field 112, a signature field 114, acheck box field 116, and a content barcode 118, wherein the content ofeach being particularly identified so as to facilitate processing of thedocument 100 as discussed in more detail below. Each of the contentfields 110 can include a content field boundary 120 such as therectangular boxes of the present example which delineate particularportions of the document content 108.

The document 100 can also include one or more form barcodes, generallyidentified by the numeral 122. The form barcode 122 can be a barcode orother decodable indicia in which there is embedded informationrespecting the document content 108. The form barcode 122 can have aform factor 124 identified by a form barcode boundary 126. In oneexample, the form barcode boundary 126 can include corners 128 and, forpurposes of the illustrative example discussed below, the corners 128include corners 128A, 128B, 128C, 128D. The form barcode 122 can alsoinclude a reference 130 such as at least one reference point 132,relative to which can be identified the position of the content fields110. Noted herein is that while the reference 130, and the referencepoint 132 in particular, are illustrated and discussed as uniqueportions of the form barcode 122, these features can also be associatedwith the form barcode boundary 126, the corners 128, or any other partsof the document 100 which can provide basis for identification of thecontent fields 110.

The relationship between the content fields 110 and the form barcode 122can be used to facilitate processing of the document 100. The inventorshave determined that this relationship can to the extent devised providefor quick locating of the content fields 110 before any detailedanalysis of image data is required. By avoiding these involved analysisand processing steps, or in one embodiment by simply searching for anddecoding the form barcode 122, embodiments of the present invention canbe used to improve throughput of document processing systems.

In one embodiment, the form barcode 122 has encoded therein contentssuch as a form structure. The form structure can be used to identifydata and information about the form design such as, for example, thelocation of the content fields 110, the information in the contentfields 110, the location of other form barcodes, and the like. In oneexample, the content is a form ID. Such form ID can be used to identifyan entry in one or more tables or databases. This entry can includeinformation about the form design, thereby providing ready access tosuch information before full processing of the captured image of thedocument 100 is required. In another example, the contents includesinformation about the relationships between the content fields 110, aswell as the relationship between the content fields 110, the formbarcode 122, and other parts of the document 100.

Relationships between the content fields 110 and the form barcode 122can be characterized by the relative position of the content fields 110with respect to the reference 130 such as with respect to the referencepoint 132. This characterization can be provided in various ways, someof which may rely on the system level concepts, constructions, andexecutable instructions provided to implement the concepts disclosedherein. By way of example, Cartesian and polar coordinate systems can beused to identify the location of each of the reference 130 (e.g., thereference point 132) and a portion of the content fields 110 such as aportion of the content field boundary 120. These coordinate systems canbe used to establish offsets and distances such as between variouslocations within the content area 106, and more particularly as theseoffsets can be used to characterize the relationship between the contentfields 110 and the form barcode 122.

The form barcode 122 can be particularly identified so as to facilitateits identification during processing of the captured image of thedocument 100. As depicted in FIG. 1, the form barcode 122 can be locatedalong one or more edges of the document 100, or otherwise in positionsthat do not interfere with the document content 108. Examples ofsuitable positions can also locate one or more of the form barcode 122in the margins of the document 100, along one or more edges of thedocument 100, and embedded within the content area 106 of the document100. These positions can also be selected to facilitate decoding of theform barcode 122 in the primary or pre-processing stages of imageanalysis.

In addition to the particular location of the form barcode 122, theconfiguration of the form barcode 122 can also be used to identify anddistinguish it from other portions of the document 100. Some of theseconfigurations can be described by the form factor 124, which describesany one of the size, shape, color, and other physical characteristicsthat can promote decoding of the information in the form barcode 122with minimal processing capability. In one example, the form barcode 122is distinguished from the surrounding areas of the document 100 by wayof its printing material (e.g., ultraviolent inks, infrared inks, andthe like). In another example, the form barcode 122 is provided on thedocument 100 in a shape that distinguishes it from other parts of thedocument 100. In yet another example, the form barcode 122 is located onthe document 100 in a pre-selected area or using pre-selectedcoordinates or in a pre-designated portion of the document 100. In stillanother example, the form barcode 122 can contain a bar code indicatorsuch as a pre-assigned geometric pattern and/or be of the type that isanew or specially-designed symbology, any one of which isdistinguishable from other barcodes and symbologies contemplated herein.

The features of the form barcode 122 can be used to quickly andaccurately locate and decode the form barcode 122 in which is stored theinformation about the document 100. Such decoding would occur duringinitial, primary, or pre-processing stages of image analysis of thedocument 100. Thus in one embodiment the form factor 124 should be ofthe type that permits such identification to occur. For example, theform factor 124 should large enough to be easily detected such as can beselected to permit decoding to occur at the initial or raw data stage,i.e., before detailed analysis and processing of the document 100. Theform factor 124 should also be large enough to represent the scale andpositions of the content fields 110 such as would be used to establish adocument coordinate system for the document 100.

In one embodiment, the coordinate system for the document 100 can haveincorporated therein the origin for the Cartesian and/or polarcoordinate systems mentioned above. The form factor 124 should still besized to allow the rest of the document content 108 to be assignedpositions, sizes, shapes, and related characteristics with sufficientresolution to permit decoding of the information found therein. In oneexample, and similar to what is depicted in FIG. 1, the form barcode 122can extend along at least about 60% of the longest side of the document100. This coverage can occur unitarily by way of one of form barcode 122(see FIG. 1), or as several ones of form barcode 122, wherein the formfactor 124 is smaller in size and dispersed and affixed at differentpositions in the content area 106 and/or the document 100 in general.

The content fields 110 can be used to identify and/or delineate portionsof the document content 108. The content field boundary 120 such as theboxes of the present example in FIG. 1 can be automatically generated byexecutable instructions provided for purposes of processing the document100, or in another example the content field boundary 120 can beidentified and generated by users of the document 100 via, e.g., asuitable user interface or graphic user interface (GUI). Particular tothe content fields 110 of the present example, the text field 112 canidentify certain pertinent text or other information of the document 100that may, for example, be necessary for ascertaining the content of thedocument 100. This text may include titles, identification numbers, pagenumbers, etc. Similarly the signature field 114 can be used toselectively identify areas of the document 100 in which there areexpected signatures, stamps, fingerprints, and other personalidentification information provided by, and/or solicited from, e.g., auser of the document 100. Examples of information identified by thecheck box field 116 can include the number of check boxes, theorientation and location of the check boxes, the collected information(e.g., the answers from the user of the document 100) indicated by eachof the check boxes, and the like. In one embodiment, the content barcode118 has encoded therein, using any one or more of the variety ofsymbologies discussed and contemplated throughout, information pertinentto the document. Information in one or more of the content fields 110can be coded into the form barcode 122, and in one particularimplementation the initial processing of the captured document imagedata can read and decode this information before processing other piecesof the captured document image data.

With continued reference to FIG. 1, and also now to FIG. 2, one exampleof the identification of the location of the content fields 110 (FIG. 1)by way of the form barcode 122 (FIG. 1) is described. FIG. 2 illustratesan example of an image 200 of, e.g., the document 100, captured usingimaging and imaging technology contemplated and described herein. Theimage 200 includes an image plane 202 with an image boundary 204, inwhich there is found an image grid 206. The image grid 206 can include aplurality of image grid lines 208 such as the horizontal grid lines 210and vertical grid lines 212 that intersect at grid points 214, asdepicted in the present example. The image grid 206 is overlaid on theimage plane 202, representing infinite imaginary lines that establish acoordinate system 216 for use in identifying and locating the relativeposition of the content fields 110 in the document 100. The image 200also includes an indicia representation 218 with corners 218A, 218B,218C, and 218D, and one or more content field representations 220, allof which are representative of corresponding features that are found onthe physical manifestation of, e.g., the document 100. The indiciarepresentation 218 is for example representative of the form barcode 122(FIG. 1).

The image boundary 204 can include the entire contents of the document100 (FIG. 1), or in other examples the image boundary 204 isrepresentative of only a portion of the document 100 (FIG. 1).Configurations of the inventive concepts of the present disclosure arecompatible with various sizes and shapes of the image boundary 204. Itwill be appreciated that it is useful to use various scaling factors,orientation factors, and other factors to determine the relative sizes,shapes, of the image boundary 204 as well as to interpolate that sizeand shape to the relative portions of the document 100 (FIG. 1) that arecaptured during decoding of the form barcode 122 (FIG. 1).

In one embodiment, to characterize the relative location of contentfield 110 (FIG. 1) in the document 100 (FIG. 1) by way of the formbarcode 122 (FIG. 1), the corners 218A, 218B, 218C, and 218D can be usedto identify the image plane 202 and to establish the coordinate system216. Because the present disclosure is primarily for use with imagingand relating imaging devices, calculations and algorithms can be used tocorrelate pixel locations with the coordinate system 216 and moreparticularly to establish the location of the horizontal 210 andvertical 212 grid lines, as well as the grid points 214 establishedtherein. Details of concepts that can be applied for use in developingand processing image data such as to identify and characterize the imagegrid 206 is found in U.S. Pat. No. 6,561,428 to Meier et al., thecontents of which is incorporated by reference in its entirety herein.

Consistent with the processing of image data, information about thelocation and position of the content fields 110 (FIG. 1) relative to oneor more of the reference point 132 (FIG. 1) can translate intocoordinate positions for each of the content field representations 220.These coordinate positions can reflect one or more of the grid points214, horizontal and vertical locations identified via the horizontal 210and vertical 212 grid lines 208, or other combination of points andlines found within the image plane 202. In one embodiment, decoding ofthe form barcode 122 (FIG. 1) is effective at providing both the layoutfor the image grid 206 (e.g., the layout and location of the image gridlines 208 and the grid points 214, as well as the relative location ofthe content fields 110 as represented by the content fieldrepresentations 220. Thus in such exemplary construction, processing ofthe document 100 (FIG. 1) is effectuate simply by decoding the formbarcode 122 (FIG. 1).

Implementation of the concepts discussed in connection with the document100 above can be further understood with reference to the exemplarydocument 300 and related system level information shown in FIG. 3. Inaddition to the document 300 and its related features (wherein likenumerals are used to identify like components as between the document100 and the document 300) there is depicted in FIG. 3 a schematicdiagram of an exemplary indicia reading terminal 334. The indiciareading terminal 334 can comprise a device structure 336 with an imagingmodule 338, a processing module 340 such as a central processing unit(“CPU”), and a storage module 342 such as memory that has at least onezone 344 for, e.g., storing certain contents about the document 300. Inone embodiment, the indicia reading terminal 334 can be operativelyconfigured with a field of view 346 established by, e.g., the imagingmodule 338. The field of view 346 can be sized to capture a documentimage 348 respecting the document 300. There are other components andhardware that can facilitate the capture of the document image data,some of which are discussed in more detail in connection with theindicia reading terminals illustrated in FIGS. 8-11 and described below.

The indicia reading terminal 336 can be part of a system 2000 having alocal server 2250, a remote server 2750, and a network 2500 that couplesthe local server 2250 and the remote server 2750. This configuration ofthe system 2000 can be utilized for processing the captured documentimage data, and in one configuration one or more of the local server2250 and the remote server 2750 is utilized to entirely process thecaptured document image data in a manner consistent with the disclosurebelow. In one embodiment, one or more of the processing module 340 andthe storage module 342, or complementary ones thereof, can be locatedoutside of the indicia reading terminal 336 so as to permit data andinformation captured by the indicia reading terminal 336 to betransferred from the indicia reading terminal 336 to, e.g., thecorresponding storage module 342 for immediate and/or further processingof the captured document image data. In another embodiment, imageprocessing steps disclosed, described, and contemplated herein can bedistributed as between the indicia reading terminal 336, the localserver 2250, and the remote server 2750, with still other embodimentsbeing configured for the image processing steps to be executed entirelyby the indicia reading terminal 336.

Symbology, coding, and other aspects of the form barcode 322 and thecontent barcode 318, may be selected in accordance with configurationand capabilities of the processing module 340. In one embodiment, theprocessing module 340 can be any type of CPU or microprocessor withexemplary functions designed to decode machine readable types ofsymbology, and particularly in connection with symbology found in thecaptured document image data. Decoding is a term used to describe thesuccessful interpretation of machine readable indicia contained in animage captured by the imaging module 338. The code has data orinformation encoded therein. Information respecting various referencedecode algorithms are available from various published standards, suchas by the International Standards Organization (“ISO”). Examples maycomprise one dimensional (or linear) symbologies, stacked symbologies,matrix symbologies, Composite symbologies, or other machine readableindicia. One dimensional (or linear) symbologies which may include verylarge to ultra-small, Code 128, Interleaved 2 of 5, Codabar, Code 93,Code 11, Code 39, UPC, EAN, MSI, or other linear symbologies. Stackedsymbologies may include PDF, Code 16K, Code 49 or other stackedsymbologies. Matrix symbologies may include Aztec, Datamatrix, Maxicode,QR Code or other 2D symbologies. Composite symbologies may includelinear symbologies combined with stacked symbologies. Other symbologyexamples may comprise OCR-A, OCR-B, MICR types of symbologies. UPC/EANsymbology or barcodes are standardly used to mark retail productsthroughout North America, Europe and several other countries throughoutthe world.

With continued reference to FIG. 3, and also now to FIG. 4, there isillustrated an exemplary embodiment of a method 400 for processing adocument (e.g., the document 300). The method 400 includes, at block402, capturing an image of the document and, at block 404, processingthe document image to identify a form barcode disposed on the document.The method 400 also includes, at block 406, decoding the form barcode,thereby retrieving the information embedded therein. In one embodiment,the method can further include, at block 408, locating other parts ofthe document including, for example, a reference of the form barcode, acoordinate system, and/or one or more content fields. In one example,the reference comprises one or more points or other features of thedocument as was discussed above.

Execution of the method 400 and similar embodiments is useful to reduceprocessing time of the document image. The processing at block 404, forexample, can be done on raw or relatively low-resolution captured imagedata to pick-up and identify the form barcode from among the backgroundnoise of the document image. This feature reduces the need forhigh-level processing techniques. Moreover, in one embodiment theprocessing requirements may be further reduced when the informationrespecting the content of the document is encoded in a low density barcode that extends substantially along the length of, e.g., an 8.5 in×11in document.

By identifying the form barcode from among the content of the documentit is possible to discern other information about the document withouthaving to fully process the document image. In one example, the formbarcode can have encoded therein information about the content such asthe relative position of the content fields with respect to the formbarcode. This relative position can be given in terms of coordinatesand/or offsets, with the origin of these coordinates being provided bythe reference associated with the form barcode. As discussed above,these coordinates can originate from a document coordinate system inwhich the origin, scale, and orientation of the document coordinatesystem can be built based on the positions of the reference points inthe document image. When embodiments of the method 400 identify thereference, such as a single reference point of the form barcode, thenthe position of the content field can be located without furtherprocessing of the image to look for specific identifying characteristicsof the respective content field.

Another exemplary embodiment of a method 500 is illustrated in FIG. 5.In one embodiment, the method 500 include, at block 502, capturing animage of the document, at block 504, determining whether a form barcodeis present in the captured image of the document. If the form barcode isnot present (or not identified in the captured image), then the method500 can also include, at block 506, requesting information such as froman end user or operator of the indicia reading terminal device and, atblock 508, determining whether the input is provided such as whether theinput is a form ID. If no entry is provide by the end user via, e.g.,manual entry, than the method 500 can continue with block 510,continuing to fully processes the captured image data. However, if theform ID or other identified information is provided, then the method 500includes at block 512, finding an entry based on the information in atable and/or database. The requested information can include, forexample, the form ID which is used to identify the entry in the table orthe database. Such entry can include a variety of information about thedocument such as the location (e.g., coordinates) of the content fields.This information is useful because full processing of the document isnot required as the information provides information of the relevant orpre-selected fields that are or may be pertinent to the particulardocument that has been imaged.

When the form barcode is present and identified, the method furtherincludes, at block 514, decoding the form barcode and, at block 516,determining whether there is encoded in the form barcode informationsuch as about the form design and/or form design data. This informationcan be all relevant information necessary to process the document,thereby saving time and processing resources. For example, if there isinformation respecting the form design and related data in the formbarcode, then the method can include at block 518, processing thedocument using the data that is encoded in the form barcode. On theother hand, if there is no form design or form design data found in theform barcode, then them method 500 can include, at block 520,determining whether the form ID is provided. Again, if the form ID isfound, then the method 500 use the form ID to retrieve information froma table or a database (e.g., at block 512). In one embodiment, themethod 500 can continue to request the input from the end user (e.g., atblock 506) and execute the remaining processing steps as depicted inFIG. 5.

Embodiments of the method 400 and the method 500 are useful, forexample, when only information about the structure is encoded in theform barcode. This information can be used to access other informationsuch as information stored in a table, database, or other repository.The stored information may provide additional details about the contentof the document. In one example, the information in the repository isderived from pre-processed documents such as those previously underprocesses and protocols of the type disclosed herein. The derivedinformation may be stored, indexed, and made available to speed upprocessing as between one or more documents such as a first document anda second document, both of which include a form barcode of the same orsimilar type and/or a form structure of the same or similarconstruction.

With continued reference to FIG. 5, and also now to FIG. 6, attention isfocused on the processing of the captured image data using the formdesign and form design data as would occur in, e.g., block 518 of FIG. 5and mentioned above. A sample of the processing steps useful for suchprocessing are provided in the example of a method 600 of processingusing the form design and form design data. In one embodiment, themethod 600 includes at block 602 identifying the position of the formbarcode in the captured image of the document and at block 604determining a coordinate system based on the position of the formbarcode. The method 600 also includes at block 606 computing a transformT that connects the coordinate system to the real image coordinatesystem. In one example, this computation can utilize the correspondencebetween the form barcode position and the real image barcode position.

In one embodiment, for each of the content fields of the document suchas those content fields identified in the form barcode, by way of theform ID, and/or in the form design and form design data, the method 600also includes at block 608 computing the real offset in the capturedimage of the content field based on the transform T. The method 600 canalso include at block 610 cropping the content field from the capturedimage using the computed offsets. In one example, the computed offsetssave processing time by identifying with particularity the location andposition of the content field, thereby directing and/or instructing theprocessing algorithm (and circuitry) to the correct location. Croppingabout the content field can likewise include executed steps, blocks, andinstructions, which in broad terms are useful to focus the processing onthe particular area of the captured image in which is located thecontent field of interest.

The method 600 can further include at block 612 determining whetheradditional content fields are present, as per for example theinformation encoded in the form barcode or otherwise made available,e.g., as being stored in memory. If additional content fields are to beprocessed, then the method 600 can in one embodiment return to block 608and/or 610 and continue processing the document. On the other hand, ifno additional content fields or all content fields have been processed,then the method can include block 614 continuing additional processingof the document.

Embodiments of the method 500 and the method 600 can be implemented bysystems (e.g., document management systems) that are configured toaccommodate variance as between the documents that are scanned. Oftenthese systems can employ cameras, hand held scanners, and the like tocapture image data of the documents. Variance can occur in the shape ofthe document, and more particularly the shape of the captured image. Inon example, the calculation and determination of the transform T permitssuch systems to compute the real position of any designated positionsuch as by using the known aspects of the form barcode (e.g., thelocation and/or position of the corners of the form barcode).

Moreover, it is also contemplated that one or more of the blocks of themethod 500 and the method 600 can be implemented together. Coordinationof these blocks can widen the scope of applications, thereby rendering arobust document management system that can processes many differenttypes of documents using the form barcode and the information encoded inthe form barcode. In one example, the information from the form barcode(e.g., the output of block 514, decoding the form barcode) can beprovided to block 602. In another example, the information about thedocument (e.g., the output of block 518, processing the document) can beprovided to block 606. In yet another example, the information about theform design and/or the form structure (e.g., the input solicited atblock 516) can be provided to block 608.

Expanding on the concepts of the present invention reference can now behad to the exemplary embodiment of a method 700 that is depicted in FIG.7. In this example, the method 700 includes a block 702 for capturing animage of a document, a block 704 for processing the document image forfinding a form barcode, and a block 706 for locating a reference of theform barcode on the document. The method 700 also includes, at block708, receiving the document such as by automated document handling thatcan manipulate bulk forms and can be related to bulk-type formprocessing systems. The method also includes a block 710 decoding theform barcode, at block 712 identifying the corners of the form barcode,and at block 714, affixing the image plane and associated coordinatesystem such as based on the corners of the form barcode. The methodfurther includes at block 716 determining if the reference (and itslocation) are encoded, and at block 718 identifying the reference by,e.g., using the location encoded in the form barcode. The method furtherincludes at block 720 determining if a content field is encoded in theform barcode. If there are no content fields encoded, then the method700 can include at block 722 continuing to fully process the documentimage such as to identify the content fields without use or referencerelative to the form barcode.

When one or more content fields are found such as by encoded locationsand/or coordinates of the content field in the form barcode, the method700 can include at block 724 finding the content field relative to thereference using, e.g., the coordinates. The method 700 can also includeat block 726 reading the information of the found content field, and atblock 728 determining if another content field is to be located. If noother content fields are designated as required or necessary forprocessing of the document, then the method 700 can continue to theblock 722 for full processing of the document image. On the other hand,if other content fields are designated, then the method 700 can continueto block 720 to determine if the new content field is encoded in theform barcode.

Embodiments of the method 700 are suitable for implementation inconnection with a system (e.g., document management systems) whereinthere is little variance from document-to-document. In one example, themethod 700 is implemented in connection with documents that have thesame or substantially similar size and shape (e.g., all of rectangularprofile with the same dimensions as the original document). The method700 can utilize offset data such as data that relates the position ofthe content fields to the form barcode. In one example, cropping canoccur by way of this offset data.

Further details of indicia reading terminals such as the indicia readingterminal 334 of FIG. 3 are illustrated in FIGS. 8-11 and discussed inmore detail below. There is provided in FIGS. 8 and 9, and described inmore detail below, an example of an imaging module 800 for use as, e.g.,the imaging module 338 (FIG. 2). In one embodiment of the indiciareading terminal 334, the imaging module 800 can comprise a focuselement 802, and an image sensor integrated circuit 804 that is disposedon a printed circuit board 806 together with an illumination patternlight source bank 808 (“the illumination bank”), and aiming patternlight source bank 810 (“the aiming bank”). Here, each of theillumination bank 808, and the aiming bank 810 is provided as a singlelight source. The imaging module 800 can also include an optical plate812 that has optics for shaping light from illumination bank 808, andthe aiming bank 810 into predetermined patterns.

Imaging module 800 can be disposed in the indicia reading terminals suchas the indicia reading terminal 334 (FIG. 2) and the exemplaryembodiment of an indicia reading terminal 900, which is shown in FIG.10. The indicia reading terminal 900 can include a hand held housing 902that supports a user input interface 904 with a pointer controller 906,a keyboard 908, a touch panel 910, and a trigger 912. The hand heldhousing 902 can also support a user output interface 914 with a display916.

Exemplary devices that can be used for devices of the user inputinterface 904 are generally discussed immediately below. Each of theseis implemented as part of, and often integrated into the hand heldhousing 902 so as to permit an operator to input one or more operatorinitiated commands. These commands may specify, and/or activate certainfunctions of the indicia reading terminal. They may also initiatecertain ones of the applications, drivers, and other executableinstructions so as to cause the indicia reading terminal 900 to operatein an operating mode.

Devices that are used for the point controller 906 are generallyconfigured so as to translate the operator initiated command into motionof a virtual pointer provided by a graphical user interface (“GUI”) ofthe operating system of the indicia reading terminal 900. It can includedevices such as a thumbwheel, a roller ball, and a touch pad. In someother configurations, the devices may also include a mouse, or otherauxiliary device that is connected to the indicia reading terminal 900by way of, e.g., via wire or wireless communication technology.

Implementation of the keyboard 908 can be provided using one or morebuttons, which are presented to the operator on the hand held housing902. The touch panel 910 may supplement, or replace the buttons of thekeyboard 908. For example, one of the GUIs of the operating system maybe configured to provide one or more virtual icons for display on, e.g.,the display 916, or as part of another display device on, or connectedto the indicia reading terminal 900. Such virtual icons (e.g., buttons,and slide bars) are configured so that the operator can select them,e.g., by pressing or selecting the virtual icon with a stylus (notshown) or a finger (not shown).

The virtual icons can also be used to implement the trigger 912. On theother hand, other devices for use as the trigger 912 may be supportedwithin, or as part of the hand held housing 902. These include, but arenot limited to, a button, a switch, or a similar type of actionablehardware that can be incorporated into the embodiments of the indiciareading terminal 900. These can be used to activate one or more of thedevices of the portable data terminal, such as the bar code readerdiscussed below.

Displays of the type suited for use on the indicia reading terminal 900are generally configured to display images, data, and GUIs associatedwith the operating system and/or software (and related applications) ofthe indicia reading terminal 900. The displays can include, but are notlimited to, LCD displays, plasma displays, LED displays, among manyothers and combinations thereof. Although preferred construction of theindicia reading terminal 900 will include devices that display data(e.g., images, and text) in color, the display that is selected for thedisplay 916 may also display this data in monochrome (e.g., grayscale).It may also be desirable that the display 916 is configured to displaythe GUI, and in particular configurations of the indicia readingterminal 900 that display 916 may have an associated interactiveoverlay, like a touch screen overlay on touch panel 910. This permitsthe display 916 to be used as part the GUI so as to permit the operatorto interact with the virtual icons, the buttons, and other implements ofthe GUI to initiate the operator initiated commands, e.g., by pressingon the display 916 and/or the touch panel 910 with the stylus (notshown) or finger (not shown).

The hand held housing 902 can be constructed so that it has a form, or“form factor” that can accommodate some, or all of the hardware anddevices mentioned above, and discussed below. The form factor definesthe overall configuration of the hand held housing 902. Suitable formfactors that can be used for the hand held housing 902 include, but arenot limited to, cell phones, mobile telephones, personal digitalassistants (“PDA”), as well as other form factors that are sized andshaped to be held, cradled, and supported by the operator, e.g., in theoperator's hand(s) as a gun-shaped device. One exemplary form factor isillustrated in the embodiment of the indicia reading terminal 900 thatis illustrated in the present FIG. 8.

An exemplary hardware platform for use in, e.g., the indicia readingterminal 334 and 900, is illustrated and described with reference to theschematic block diagram of FIG. 11. In FIG. 11, it is seen that anindicia reading terminal 1000 (“the terminal”) can include an imagesensor 1002 comprising a multiple pixel image sensor array 1004 (“theimage sensor array”) having pixels arranged in rows and columns ofpixels, including column circuitry 1006 and row circuitry 1008.Associated with the image sensor 1002 can be amplifier circuitry 1010,and an analog to digital converter 1012 which converts image informationin the form of analog signals read out of image sensor array 1004 intoimage information in the form of digital signals. Image sensor 1002 canalso have an associated timing and control circuit 1014 for use incontrolling, e.g., the exposure period of image sensor 1002, and/or gainapplied to the amplifier 1010. The noted circuit components 1002, 1010,1012, and 1014 can be packaged into an image sensor integrated circuit1016. In one example, image sensor integrated circuit 1016 can beprovided by an MT9V022 image sensor integrated circuit available fromMicron Technology, Inc. In another example, image sensor integratedcircuit 1016 can incorporate a Bayer pattern filter. In such anembodiment, CPU 1018 prior to subjecting a frame to further processingcan interpolate pixel values intermediate of green pixel values fordevelopment of a monochrome frame of image data. In other embodiments,red, and/or blue pixel values can be utilized for the monochrome imagedata.

In the course of operation of terminal 1000 image signals can be readout of image sensor 1002, converted and stored into a system memory suchas RAM 1020. A memory 1022 of terminal 1000 can include RAM 1020, anonvolatile memory such as EPROM 1024, and a storage memory device 1026such as may be provided by a flash memory or a hard drive memory. In oneembodiment, terminal 1000 can include CPU 1018 which can be adapted toread out image data stored in memory 1022 and subject such image data tovarious image processing algorithms. Terminal 1000 can include a directmemory access unit (DMA) 1028 for routing image information read outfrom image sensor 1002 that has been subject to conversion to RAM 1020.In another embodiment, terminal 1000 can employ a system bus providingfor bus arbitration mechanism (e.g., a PCI bus) thus eliminating theneed for a central DMA controller. A skilled artisan would appreciatethat other embodiments of the system bus architecture and/or directmemory access components providing for efficient data transfer betweenthe image sensor 1002 and RAM 1020 are within the scope and the spiritof the invention.

Referring to further aspects of terminal 1000, terminal 1000 can includean imaging lens assembly 1030 for focusing an image of a form barcode1032 located within a field of view 1034 on a substrate 1036 onto imagesensor array 1004. Imaging light rays can be transmitted about anoptical axis 1040. The imaging lens assembly 1030 can be adapted to becapable of multiple focal lengths and/or multiple best focus distances.

Terminal 1000 can also include an illumination pattern light source bank1042 for generating an illumination pattern 1044 substantiallycorresponding to the field of view 1034 of terminal 1000, and an aimingpattern light source bank 1046 for generating an aiming pattern 1048 onsubstrate 1036. In use, terminal 1000 can be oriented by an operatorwith respect to a substrate 1036 bearing the form barcode 1032 in suchmanner that aiming pattern 1048 is projected on the form barcode 1032.In the example of FIG. 9, the form barcode 1032 is provided by a 1D barcode symbol. Form barcode could also be provided by 2D bar code symbols,stacked linears, or optical character recognition (OCR) characters, etc.

Each of illumination pattern light source bank 1042 and aiming patternlight source bank 1046 can include one or more light sources. Theimaging lens assembly 1030 can be controlled with use of lens assemblycontrol circuit 1050 and the illumination assembly comprisingillumination pattern light source bank 1042 and aiming pattern lightsource bank 1046 can be controlled with use of illumination assemblycontrol circuit 1052. Lens assembly control circuit 1050 can sendsignals to the imaging lens assembly 1030, e.g., for changing a focallength and/or a best focus distance of imaging lens assembly 1030. Thiscan include for example providing a signal to the piezoelectric actuatorto change the position of the variable position element of the focuselement discussed above. Illumination assembly control circuit 1052 cansend signals to illumination pattern light source bank 1042, e.g., forchanging a level of illumination output by illumination pattern lightsource bank 1042.

Terminal 1000 can also include a number of peripheral devices such asdisplay 1054 for displaying such information as image frames capturedwith use of terminal 1000, keyboard 1056, pointing device 1058, andtrigger 1060 which may be used to make active signals for activatingframe readout and/or certain decoding processes. Terminal 1000 can beadapted so that activation of trigger 1060 activates one such signal andinitiates a decode attempt of the form barcode 1032.

Terminal 1000 can include various interface circuits for couplingseveral of the peripheral devices to system address/data bus (systembus) 1062, for communication with CPU 1018 also coupled to system bus1062. Terminal 1000 can include interface circuit 1064 for couplingimage sensor timing and control circuit 1014 to system bus 1062,interface circuit 1068 for coupling the lens assembly control circuit1050 to system bus 1062, interface circuit 1070 for coupling theillumination assembly control circuit 1052 to system bus 1062, interfacecircuit 1072 for coupling the display 1054 to system bus 1062, andinterface circuit 1076 for coupling the keyboard 1056, pointing device1058, and trigger 1060 to system bus 1062.

In a further aspect, terminal 1000 can include one or more I/Ointerfaces 1073, 1080 for providing communication with external devices(e.g., a cash register server, a store server, an inventory facilityserver, a peer terminal, a local area network base station, a cellularbase station, etc.). I/O interfaces 1073, 1080 can be interfaces of anycombination of known computer interfaces, e.g., Ethernet (IEEE 802.3),USB, IEEE 802.11, Bluetooth, CDMA, GSM, IEEE 1394, RS232 or any othercomputer interface.

It is contemplated that numerical values, as well as other values thatare recited herein are modified by the term “about”, whether expresslystated or inherently derived by the discussion of the presentdisclosure. As used herein, the term “about” defines the numericalboundaries of the modified values so as to include, but not be limitedto, tolerances and values up to, and including the numerical value somodified. That is, numerical values can include the actual value that isexpressly stated, as well as other values that are, or can be, thedecimal, fractional, or other multiple of the actual value indicated,and/or described in the disclosure.

While the present invention has been particularly shown and describedwith reference to certain exemplary embodiments, it will be understoodby one skilled in the art that various changes in detail may be effectedtherein without departing from the spirit and scope of the invention asdefined by claims that can be supported by the written description anddrawings. Further, where exemplary embodiments are described withreference to a certain number of elements it will be understood that theexemplary embodiments can be practiced utilizing either less than ormore than the certain number of elements.

1. A system for processing a document comprising, an indicia readingterminal comprising a two dimensional image sensor array comprising aplurality of pixels extending along an image plane, an optical assemblyfor use in focusing imaging light rays onto the plurality of pixels ofsaid two dimensional image sensor array, and a housing encapsulating thetwo dimensional image sensor array and the optical assembly, wherein thesystem is operative in a mode in which the system, in response to anoperator initiated command, captures a frame of image data and processesthe frame of image data for attempting to decode a form barcode on thedocument, wherein the system is further operative to identify acoordinate system on an image plane from information stored in the formbarcode, wherein the system is yet further operative to identifyrelative to the form barcode and in the coordinate system the positionof a content field located on the document, and wherein processing ofthe frame of image data on a first document having the form barcodedisposed thereon is faster than processing of the frame of image data ona second document without the form barcode.
 2. A system according toclaim 1 wherein the system is operative to identify a form ID encoded inthe form barcode, and wherein the form ID identifies an entry in atable.
 3. A system according to claim 1 wherein the system is operativeto located and decode the form barcode before other content fields ofthe document.
 4. A system according to claim 3 wherein the system isfurther operative to identify a pre-assigned geometric pattern encodedin the form barcode.
 5. A system according to claim 1 wherein the systemis operative to identify at least one corner of the form barcode, andwherein the coordinate system is located relative to the identifiedcorner.
 6. A system according to claim 1 wherein the system is operativeto identify information in the content field from the form barcode.
 7. Asystem according to claim 1 wherein the system is operative to locate atleast one corner of the form barcode, wherein the system is operative tolocate a reference on the form barcode relative to the at least onecorner, and wherein the system is operative to locate the content fieldrelative to the reference.
 8. A system according to claim 1 wherein thesystem is operative to establish a grid having horizontal and verticalgrid lines on the image plane, wherein the system is further operativeto locate the content field on the grid, and wherein the grid isassociated with the coordinate system.
 9. A system for automatedlyhandling documents, said system comprising: an indicia reading terminalcomprising a two dimensional image sensor array comprising a pluralityof pixels extending along an image plane, an optical assembly for use infocusing imaging light rays onto the plurality of pixels of said twodimensional image sensor array, and a housing encapsulating the twodimensional image sensor array and the optical assembly; an externalserver in communication with the indicia reading terminal, the externalserver external to the indicia reading terminal; wherein the system isoperative in a mode in which the system, in response to an operatorinitiated command, captures a frame of image data and processes theframe of image data for attempting to decode a form barcode on thedocument, wherein the system is operative to form an image plan on whichis located a grid respecting a coordinate system, wherein the grid hasgrid points established from at least one corner of the form barcode,wherein the system is further operative to identify on the grid acontent field with coordinates in the coordinate system that correspondto information encoded in the form barcode, and wherein processing ofthe frame of image data on a first document having the form barcodedisposed thereon is faster than processing of the frame of image data ona second document without the form barcode.
 10. A method of processing adocument comprising: capturing a frame of image data corresponding tothe document; processing the frame of image data to locate a formbarcode affixed to the document; establishing a coordinate system on animage plane respecting the captured image data; and locating relative tothe form barcode and on the coordinate system a content field on thedocument, wherein processing of the frame of image data on a firstdocument having the form barcode disposed thereon is faster thanprocessing of the frame of image data on a second document without theform barcode.
 11. A method according to claim 10 further comprisingidentifying from the form barcode a form design, wherein the form designincludes information respecting one or more of the location and contentof the content fields of the document.
 12. A method according to claim10 further comprising: decoding the form barcode; and identifying anentry in a table, wherein the entry corresponds to information in theform barcode.
 13. A method according to claim 10 further comprisingcomputing a transform and using the transform to compute the offset forthe content field in the frame of image data.
 14. A method according toclaim 13 further comprising cropping the frame of image data about thecontent field.
 15. A method according to 10 further comprising locatingat least one corner of the form barcode, wherein the coordinate systemis established relative to the at least one corner.
 16. A methodaccording to 10 further comprising finding a reference from the formbarcode, wherein the position of the content field is relative to thereference.
 17. A method according to claim 16 further comprising:attempting to decode the form barcode; and identifying the referencefrom the decoded form barcode.
 18. A method according to claim 10further comprising receiving the first document and the second documentvia automated feeding mechanism.
 19. A method according to claim 10wherein the position of the content area is embedded in the formbarcode.
 20. A method according to claim 10 wherein the processing iscompleted on an external server external to an indicia reading terminalfor capturing the frame of image data.